Volumetric ultrasound image data reformatted as an image plane sequence

ABSTRACT

An ultrasound probe acquires a 3D image dataset of a volumetric region of the body. The 3D image data is reformatted into a sequence of successive parallel image planes extending in one of three orthogonal directions through the volume. The sequence of images is preferably formatted in accordance with the DICOM standard so that a clinician can review the 3D image data as a sequence of DICOM images on an image workstation.

CROSS-REFERENCE TO RELATED APPLICATIONS

This application is a continuation of U.S. patent application Ser. No.13/636,613, filed on Sep. 21, 2012, which is the U.S. National PhaseApplication under 35 U.S.C. § 371 of International Application No.PCT/IB2011/051125, filed on Mar. 17, 2011, which claims the benefit ofProvisional Application Ser. No. 61/316,471, filed on Mar. 23, 2010.These applications are hereby incorporated by reference herein.

This invention relates to medical diagnostic ultrasound systems and, inparticular, to ultrasound systems for three dimensional (3D) imagingwhich are capable of exporting volumetric image data as a sequence ofplanar images. Ultrasonic diagnostic imaging has traditionally scannedtwo-dimensional cross-sectional images of anatomy of the body. As thetechnology has developed, ultrasound can now scan and image threedimensional volumes, in both still images and real time. The 3D datasetsof a scanned volume can be successively rendered as three dimensionalviews, rapidly enough for the clinician to observe the motion of theanatomy in real time movement. But radiologists and cardiologists arestill more familiar with seeing the standard 2D planar images of anatomyand many are still not comfortable with diagnosing anatomy in 3D, achallenge made more difficult by the tissue clutter which oftensurrounds and obscures the region of interest at the center of thevolume being imaged. As a result, many physicians prefer to see planar2D image “slices” of a 3D volume. Once a 3D volume image dataset hasbeen captured, a technique called multiplanar reformatting enables theclinician to select one or more cut planes through the volume forviewing as 2D images. In the typical user interface the clinician canposition three orthogonal lines in the volume image. Each linerepresents the position of one of three orthogonal image planes throughthe volume, an x-y plane (azimuth vs. depth), a y-z plane (depth vs.elevation, generally referred to as a C plane), and an x-z plane(azimuth vs. elevation). As the lines are repositioned, 2D images of thecorresponding cut planes are formed by the voxels of the datasetintercepted by the cut planes. See U.S. Pat. No. 6,572,547 (Miller etal.), which illustrates the use of such cut planes to visualize the tipof a catheter from the three different imaging perspectives.

A further limitation of three dimensional imaging is that the datasetsof 3D images are formatted differently by various ultrasound imagingsystem vendors, as the vendors try to process and accommodate thestorage of the large (3D) datasets inherent in three dimensionalimaging. In an effort to align these different proprietary approaches, aworking group of the DICOM Standards Committee published Supplement 43to the standard in April, 2009 directed specifically to a DICOM standardfor storing 3D ultrasound images. However implementation of thisstandard for 3D ultrasound images has not been rapid, and the plans ofdifferent vendors for converting imaging systems such as PACS systems tothe new 3D standard remain largely unknown. Accordingly there remains aneed to provide 3D image data in a standardized format which readilylends itself to transport and use on other medical image platforms whichhave not implemented the DICOM standard for 3D ultrasound images.

In accordance with the principles of the present invention, anultrasound system is described which reformats 3D image data as one ormore sequences of 2D images in respective cut plane directions which canbe ported to other imaging platforms and replayed and diagnosed as astandardized 2D real time image sequence. A user interface providesselection of the cut plane direction, the spacing of the planes, and/orthe number of images in the sequence. The volume is then reformattedinto planar images in the selected cut plane direction(s) and stored asone or more image sequences, enabling replay of each sequence on mostconventional medical imaging platforms, preferably as 2D DICOM imagesequences.

In the drawings:

FIG. 1 illustrates in block diagram form an ultrasound systemconstructed in accordance with the principles of the present invention.

FIG. 2 illustrates a sequence for acquiring a 3D dataset andreformatting the data as one or more planar image sequences inaccordance with the present invention.

FIG. 3 illustrates lines over a 3D image indicating position of cutplanes in accordance with the present invention.

FIG. 4 illustrates the formation of three planar image sequences from avolumetric image dataset in accordance with the present invention.

Referring to FIG. 1, an ultrasound system constructed in accordance withthe principles of the present invention is shown in block diagram form.An ultrasound probe 10 with an array transducer 12 transmits ultrasoundwaves into the body of a patient and receives echoes from a volumetricregion in response. Several techniques are known for ultrasonicallyscanning a volumetric region of the body. One is to move an ultrasoundprobe containing a one-dimensional array transducer over the skin in adirection normal to the image plane of the probe. The probe will thusacquire a succession of substantially parallel image planes as the probeis moved, and the image data of the image planes comprises a 3D imagedataset. This manual technique, referred to as freehand scanning, isdescribed in U.S. Pat. No. 5,474,073 (Schwartz et al.) A secondtechnique is to mechanically oscillate the transducer array back andforth inside a compartment of the probe. The probe will thus acquire thesame data from a succession of substantially parallel image planes as inthe freehand technique, but in this case the mechanical oscillation ofthe transducer array may be rapid enough to produce real time 3D images.The third approach is to use a probe with a two-dimensional arraytransducer, from which beams can be electronically scanned in threedimensions by phased array beam steering. A 3D probe with atwo-dimensional array for this purpose is described in U.S. Pat. No.5,993,390 (Savord et al.) This third approach advantageously uses aprobe with no moving parts, and electronic beam steering can be donerapidly enough to scan even the heart with real time imaging. Each ofthese scanning techniques is capable of producing a 3D image datasetsuitable for use with the present invention.

The echo signals received by the individual transducer elements of thearray 12 are processed by a beamformer 14 to form coherent echo signalsrelating to specific points in the body. The echo signals are processedby a signal processor 16. Signal processing may include separation ofharmonic echo signal components for harmonic imaging and clutterremoval, for example. The processed signals are arranged into images ofa desired format such as a trapezoidal sector or a cube by an imageprocessor 18. The 3D image data is organized by its x-y-z coordinates inthe volumetric region and stored in an image memory 20. The 3D imagedata is rendered into a three-dimensional image by a volume renderer 22.A series of volume rendered images may be dynamically displayed inkinetic parallax so that the user may rotate, re-orient and repositionthe volume from different viewing perspectives as described in U.S. Pat.No. 6,117,080 (Schwartz). The images are processed for display by adisplay processor 24 which can overlay the 3D image with graphics, andthe image is displayed on an image display 26.

A 3D volumetric image can also be examined by “slicing through” thevolume and displaying a particular slice as a 2D image. The location ofthe slice in the volume is selected by user manipulation of a control ona user control interface 28. The user control will select a particular2D plane in the 3D volume as described above, and a multi-planarreformatter 30 selects the planar data of the 3D dataset which havecoordinates in the selected plane. The 2D image of the selected plane isshown on the display 26, either alone or in conjunction with the 3Dimage. As previously described, the user control interface can presentthe user with three differently colored lines or cursors, each of whichcan select a plane of a respective mutually orthogonal orientation. Theuser can thus simultaneously view three orthogonal planes through the 3Dvolume, as described in U.S. Pat. No. 6,572,547 (Miller et al.), forexample. In accordance with the principles of the present invention, theimage data of a 3D volume is arranged in a sequence of images ofsequential, parallel planes of the volume. The sequence of images may bestored as a sequence of frames within an ultrasound DICOM multi-frameimage, which can be stored and replayed on most medical imageworkstations and PACS systems in the manner of a 2D image sequencestored in an ultrasound DICOM multi-frame image. A clinician can therebyview the image data of the 3D volume as a sequence of cut planes throughthe volume. The clinician can replay the image sequence rapidly, givingthe impression of “swimming through” the volume. Or, the clinician canstep through the sequence slowly or pick out a particular image in aplane which cuts through a region of interest for diagnosis. The 3Dvolume data can thus be reviewed as 2D images with which the clinicianis more comfortable and familiar than a 3D volume image.

In the implementation of FIG. 1, the user operates the user controlinterface to select the orientation of the planes of the 2D imagesequence (or sequences) to be created. Standard 2D images have anazimuth (x) dimension and a depth (y) dimension and the clinician may,for example, want to have the cut planes oriented in a succession of x-yplanes, each with a different z (elevation) coordinate in the volume.This selection is applied to the multi-planar reformatter 30, whichselects a sequence of x-y image planes of the 3D dataset. This sequenceof x-y cut plane images is coupled to an image sequencer 32, whichprocesses the images as a succession of 2D images. The image sequencecan have a proprietary (custom) format used by the particular ultrasoundsystem, but preferably the 2D images are processed in compliance withthe DICOM standard for two-dimensional medical images. With DICOMstandard formatting, the image sequence can be replayed and viewed on awide variety of medical image platforms. The 2D image sequence is storedin a Cineloop® memory 34 as a sequence or “loop” of 2D images. The imagesequence can be sent to other imaging systems and platforms by way ofthe image data port of the ultrasound system. An image sequence of thepresent invention can be ported to an image review workstation inanother department of a hospital over the hospital's image data network,for instance.

In a preferred implementation of the present invention the user canspecify and select additional parameters of the 2D image sequence of the3D volume. As shown in FIG. 1, the user control interface 28 uses thesame or other user controls to specify other characteristics of a 2Dimage sequence, including selecting the number of images of the sequenceand the plane-to-plane spacing of the cut planes of the sequence. Theuser controls may also provide the ability for the user to select aparticular sub-volume of the 3D volume for the cut planes. For example,the user may select just the central one-third of the volume for the 2Dimage sequence. As another example, the entire 3D volume is to bereformatted into 2D image planes in a sequence of 100 image planes. Themulti-planar reformatter takes this selection and distributes the 100cut planes at equal intervals over the volume in the selectedorientation. As another example, the user selects a 2 mm plane-to-planespacing, and the multi-planar reformatter cuts the 2D image planes at 2mm intervals through the volume in the selected orientation.

FIG. 2 illustrates a process for producing and exporting a 2D imagesequence of a 3D volume in accordance with the present invention. Instep 40 the clinician scans a volumetric region of the body to acquire a3D dataset. In step 42 the clinician observes the rendered 3D image andselects one or more plane orientations for one or more image sequencesinto which the volume is to be sliced by the multi-planar reformatter.The clinician may select two sequences, for example, one with the cutplanes having x-y coordinates and another with the cut planes having y-zcoordinates. In a constructed embodiment the selection of the planeorientation for a sequence is done by selecting and viewing a particularMPR image plane. The other images of the sequence will then be formattedin planes parallel to the selected plane. In step 44 the clinicianselects the number of image planes of each sequence. The clinician mayselect 50 planes for the x-y plane sequence and 20 planes for the y-zplane sequence, for example. In step 46 the clinician selects the imageplane spacing. The clinician may select a 1 mm spacing for the x-yplanes and a 2 mm spacing for the y-z planes, for example. If theinter-plane spacing of this step is too large for the number of planesselected in step 44, the system will notify the user of the conflict sothat the user can select one parameter or the other. If the inter-planespacing selected is too small for the full volume, the system willdistribute the number of plane selected with the selected inter-planespacing about the center of the volume, where users most frequentlyposition the region of interest. Alternatively, the user may specify asub-region of the volume over which the planes are to be distributed. Inthe constructed embodiment there is no need to perform steps 44 and 46;the ultrasound system automatically produces planes of image data fromone side of the 3D volume to the other, and produces image planes at thesmallest plane-to-plane spacing permitted by the ultrasound system. Instep 48 the multi-planar reformatter and the image sequencer produce thespecified image sequence(s). In step 50 the image sequence(s) areexported to an image workstation as an ultrasound DICOM multi-frameimage for review and diagnosis.

FIG. 3 is an image display on the screen of display 26 which illustratesa grid of cut plane lines which show the user the planes which will bereformatted into sequences of 2D images. On the left side of the displayscreen 60 is an ultrasound image 66 which is oriented in the x-y plane.Overlaying this image 66 is a grid of vertical lines 64, which indicatea series of cuts through the volume in the y-z (elevation) direction.This grid 64 shows the user that the portion of the volume spanned bythese thirty cut planes will be reformatted into a sequence of thirty 2Dimages in the y-z dimension. On the right side of the display is asecond image 68 through the volume in the x-y dimension which isoverlaid with a grid of horizontal lines 62. This grid 62 shows the userthat a sub-region of the volume extending from near the top of the imagedown to about two-thirds of the full image depth will be reformattedinto a sequence of thirty C-plane images, that is, images which are eachin the x-z dimension and are at successive depths (y-directionincrements) of the volume. The grid 62 is backed by a graphical box 60which at the top indicates with small tick-marks the locations of thecut planes in the y-z dimension which is set over the left-side image66. Thus, the user can see at a glance the relative locations of the twosets of orthogonal grid lines and cut planes.

The user is also given the ability to rotate or tilt a grid 62,64 andthereby create cut plane lines which are tilted or rotated with respectto the nominal orientation of purely horizontal or vertical cut planes.

FIG. 4 illustrates three image sequences 74, 84, 94 which are producedby an implementation of the present invention. The display screen 70 onthe left side of FIG. 4 shows an ultrasound image 72 cut through thevolume in the x-y dimension, and an image sequence 74 of 2D images whichare in successive x-y planes through the volume and 3D dataset. In thecenter of FIG. 4 is a display screen 80 showing an image 84 in the y-zplane and below this image is an image sequence 84 of images insuccessive y-z cut planes through the volume and 3D dataset. On theright side of FIG. 4 is a display screen 90 showing a C-plane (x-zdimension) 92 and below it is a sequence 94 of images cut throughsuccessive x-z planes of the volume and 3D dataset. The three imagesequences show images cut through mutually orthogonal planes of thevolume and 3D dataset, one which progresses in the z direction, a secondwhich progresses in the x direction, and the third which progresses inthe y direction. The user can export one, two, or all three imagesequences as DICOM images to an image workstation for further analysisand diagnosis.

Since each cut plane is through the full 3D image dataset, each 2D cutplane image thus intersects and contains all of the image data acquiredfor the particular reformatted image. In a preferred embodiment the 2Dimages are in Cartesian coordinates and each image sequence is ofsuccessive cut planes in a respective orthogonal Cartesian coordinatedirection. The 2D images are thus suitable for measurement andquantification to the same degree as a standard 2D image acquired byconventional means by a one-dimensional array transducer.

What is claimed is:
 1. An ultrasonic diagnostic imaging systemconfigured to acquire a three dimensional (3D) image data of avolumetric region of a body and output a multi-frame image comprising asequence of equally spaced two dimensional (2D) images in place of the3D image data to represent the volumetric region in a memory, the systemcomprising: an ultrasound probe configured to acquire a 3D image datasetof the volumetric region; a display configured to display a volumerendering of the 3D image dataset; a user interface comprising a controland configured to receive an indication from a user, via the control, ofa cutting direction through the 3D image dataset after the displaydisplays the volume rendering; a multiplanar reformatter configured toautomatically generate, responsive to the indication, a first pluralityof 2D images at equally spaced planes through the 3D image dataset; animage sequencer configured to process the 2D images by arranging thefirst plurality of 2D images into a sequence of 2D images for storingthe sequence of 2D images independent of the 3D image dataset; and aCineloop memory which is configured to store the sequence of 2D imagesas a sequence of frames in a multi-frame image in which individual 2Dimages are stored, in sequential order, as individual frames of themulti-frame image for exporting from the ultrasonic diagnostic imagingsystem independent of the 3D image dataset.
 2. The ultrasonic diagnosticimaging system of claim 1, wherein the first plurality of 2D images isautomatically generated to include a sufficient number of 2D images suchthat an entire portion of the volumetric region is represented by the 2Dimages of the first plurality of 2D images.
 3. The ultrasonic diagnosticimaging system of claim 2, wherein the sufficient number is based on aspecified plane-to-plane spacing, a specified number of cut planes, orboth.
 4. The ultrasonic diagnostic imaging system of claim 1, furthercomprising a data port, coupled to the image sequencer, and configuredto receive the multi-frame image comprising the sequence of 2D imagesfor transferring the multi-frame image comprising the sequence of 2Dimages to another imaging system or to a storage device for subsequentlyvisualizing or storing a representation of the volumetric region,without transferring or storing the 3D image dataset.
 5. The ultrasonicdiagnostic imaging system of claim 1, wherein the display is furtherconfigured to display one or more of the 2D image sequences.
 6. Theultrasonic diagnostic imaging system of claim 1, wherein the multi-frameimage is a DICOM multi-frame image.
 7. The ultrasonic diagnostic imagingsystem of claim 1, wherein the multi-frame image is configured to enablea user to replay the sequence of 2D images on the display to give animpression of “swimming through” the volumetric region and is furtherconfigured to enable the user to step through individual ones of the 2Dimages for selecting a particular one of the 2D images.
 8. Theultrasonic diagnostic imaging system of claim 1, wherein the indicationof the cutting direction through the 3D dataset is generated responsiveto user input.
 9. The ultrasonic diagnostic imaging system of claim 8,wherein the indication of the cutting direction is generated responsiveto a selection of a 2D image plane through the displayed volumerendering of the 3D image dataset.
 10. The ultrasonic diagnostic imagingsystem of claim 8, wherein the user control interface is furtherconfigured to receive user input indicative of a specifiedplane-to-plane spacing.
 11. The ultrasonic diagnostic imaging system ofclaim 10, wherein the user control interface is further configured toreceive user input indicative of a specified number of cut planes,wherein the multiplanar reformatter is configured to automaticallygenerate the first plurality of 2D images to include a number of equallyspaced 2D images equal to the number of cut planes.
 12. The ultrasonicdiagnostic imaging system of claim 11, further comprising a displayprocessor coupled to the display, wherein the display processor isconfigured to produce a graphic for overlaying the volume rendering,wherein the graphic is configured to provide an indication of spatiallocations of the cut planes.
 13. The ultrasonic diagnostic imagingsystem of claim 12, wherein the graphic comprises a grid of cut planelines, and wherein the user interface is further configured to receiveuser input indicative of an adjustment of a number of the cut planelines of the grid, a spacing of the cut plane lines of the grid, aposition of the cut plane lines relative to the volume rendering, or acombination thereof.
 14. The ultrasonic diagnostic imaging system ofclaim 13, wherein the user interface further comprises a user control bywhich a user can rotate or tilt the grid of cut plane lines relative tothe volume rendering.
 15. The ultrasonic diagnostic imaging system ofclaim 1, wherein the multiplanar reformatter is further configured toautomatically generate, responsive to the indication, at least oneadditional plurality of 2D images of equally spaced planes which areorthogonal to at least one of the equally spaced planes of the firstplurality of 2D images, and wherein the image sequencer is configured toproduce at least one additional sequence of 2D images of the at leastone additional plurality of 2D images.
 16. The ultrasonic diagnosticimaging system of claim 3, wherein the specified plane-to-plane spacingis preprogrammed into the ultrasonic diagnostic imaging system.
 17. Theultrasonic diagnostic imaging system of claim 16, wherein the specifiedplane-to-plane spacing corresponds to a minimum preprogrammedplane-to-plane spacing.
 18. The ultrasonic diagnostic imaging system ofclaim 3, wherein the specified plane-to-plane spacing is set responsiveto user input.
 19. The ultrasonic diagnostic imaging system of claim 3,wherein the user interface is configured to receive user inputindicative of the specified plane-to-plane spacing, the specified numberof cut planes, and the entire portion of the volumetric region; andprovide a warning if the specified number of cut planes andplane-to-plane spacing define a volume larger than the entire portion ofthe volumetric region.
 20. The ultrasonic diagnostic imaging system ofclaim 3, wherein the multiplanar reformatter is configured to receive anindication of one of: (i) the specified plane-to-plane spacing or (ii)the specified number of cut planes, and to automatically determine: whenthe indication indicates the specified plane-to-plane spacing, a numberof cut planes such that the first plurality of 2D images of the firstplurality represents the entire portion of the volumetric image; or whenthe indication indicates the specified number of cut planes, aplane-to-plane spacing such that the first plurality of 2D images of thefirst plurality represents the entire portion of the volumetric region.21. The ultrasonic diagnostic imaging system of claim 20, wherein theentire portion of the volumetric region is the entire volumetric region.